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constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define a pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein the pipe is a connected group of multiple ones of the 
modules, at least one of the modules being a restructuring module; 

providing a common memory area accessible to the modules within the pipe for storing 
streaming data; 

allocating composite frames in the common memory area, each composite frame having 
predefined subframes; 

transporting the streaming data through different ones of the modules in the group in 
different ones of the subframes; and 

restructuring the data among at least some of the subframes in the restructuring module. 

2. (Previously presented) A computer readable medium having computer executable 
instructions for a digital computer to perform steps comprising the method of claim 1 . 

3. (Previously presented) The method of claim 1 where the composite frame is a physical 
frame in the common memory area. 

4. (Previously presented) The method of claim 3 where the subframes are virtual frames 
defined in the common memory area. 

5. (Original) The method of claim 1 further comprising assigning an allocator for the 
composite frames to one of the modules in the pipe. 

6. (Previously presented) The method of claim 5 where the allocator is assigned to a farthest 
upstream restructuring module in the pipe- 
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7. (Previously presented) The method of claim 5 where the allocator is assigned to a farthest 
downstream restructuring module in the pipe. 

8. (Original) The method of claim 1 further comprising constructing a frame nesting tree 
specifying how the data is to be restructured in the restructuring module. 

9. (Canceled) The method of claim 1 further comprising: 

repeating the above steps for further pipes including further modules in the computer, 
joining the pipes together into a graph. 

10. (Original) The method of claim 1 where transporting the streaming data includes issuing 
a control transaction to the restructuring modules only when all of the subframes processed by 
that module become available. 

1 1 . (Previously presented) A method for processing frames of streaming data through 
multiple modules disposed in a pipe in a digital computer, comprising: 

constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define the pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein the pipe is a connected group of multiple ones of the 
modules, at least one of the modules being a restructuring module; 

allocating a composite frame having multiple subframes; 

performing operations upon the subframes in any of the modules sourcing data to the 
restructuring module; 

after completion of the operations for all of the subframes sourcing data to the 
restructuring module, issuing a control transaction to the restructuring module; and 
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performing operations upon the subframes sourced to the restructuring module in 
response to the control transaction. 

12_ (Previously presented) A computer readable medium having computer executable 
instructions for a digital computer to perform steps comprising the method of claim 11. 

13. (Previously presented) The method of claim 1 1 where allocating the composite frame 
includes constructing a frame control table having an entry for each module in the pipe and a flag 
for each of the modules indicating whether a particular module has completed an operation upon 
the subframe, 

14. (Previously presented) The method of claim 13 further comprising setting one of the flags 
whenever a module has completed an operation upon a subframe. 

1 5. (Original) The method of claim 1 1 further including constructing an offset table 
specifying the structure of the subframes within the composite frame. 

1 6. (Original) The method of claim 1 1 further comprising constructing a pipe control table 
specifying the structure of the modules in the pipe. 

1 7. (Original) The method of claim 1 6 where the pipe control table has an entry for at least 
some of the modules in the pipe, and where each entry specifies which other module or modules 
source data to one of the modules in the pipe. 

1 8. (Original) The method of claim 16 where the pipe control table has tin entry for each 
module in the pipe that sources data from outside the pipe. 
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19. (Previously presented) The method of claim 1 1, wherein the pipe accommodates 
performance of operations upon a plurality of composite frames concurrently. 

20. (Original) The method of claim 1 9 further comprising constructing a separate frame 
control table for each of the composite frames. 

2 1 . (Previously presented) A method for processing frames of streaming data through 
modules including multiple restructuring modules in a digital computer, comprising: 

constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define a pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein each pipe is a connected group of multiple ones of 
the modules including the restructuring modules; 

assigning a single allocator to one of the modules; 

allocating composite frames having predefined subframes associated with respective ones 
of the restructuring modules; 

transporting the streaming data through different ones of the modules in the group in 
different ones of the subframes; and 

restructuring the data among the subframes in the restructuring modules. 

22. (Previously presented) A computer readable medium having computer executable 
instructions for a digital computer to perform steps comprising the method of claim 21 . 

23. (Original) The method of claim 2 1 further comprising constructing a frame nesting tree 
specifying how the data is restructured by the restructuring module. 
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24. (Original) The method of claim 21 further comprising collecting a constant-offset flag 
for each module. 



25. (Original) The method of claim 24 further comprising collecting an offset value for any 
module whose constant-flag is set 

26. (Original) The method of claim 24 further comprising constructing rin offset table 
specifying relationships of the subframes to the composite frame. 

27. (Original) The method of claim 24 further comprising specifying memory sizes for each 
of the subframes within the composite frame. 

28. (Original) The method of claim 21 where a plurality of the restructuring modules are of a 
single type in a cascade in the pipe. 

29. (Original) The method of claim 28 where the allocator is assigned to a particular module 
in response to the type of cascaded modules. 

30. (Original) The method of claim 28 where the plurality of cascaded modules are mixers, 
and where the allocator is assigned to a downstream one of the cascaded mixers. 

3 1 . (Original) The method of claim 28 where the plurality of cascaded modules are splitters, 
and where the allocator is assigned to an upstream one of the cascaded splitters. 

32. (Original) The method of claim 21 where transporting the streaming data includes 
issuing control transactions to the restructuring modules only when all of the subframes 
processed by respective ones of the modules become available. 
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33. (Previously presented) A method for processing frames of streaming data through 
modules including multiple restructuring modules connected in a pipe in a digital computer, 
comprising; 

constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define the pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein the pipe i$ a connected group of multiple ones of the 
modules; 

allocating a composite frame having multiple subframes for different ones of the 
restructuring modules; 

performing data-sourcing operations upon certain of the subframes in source ones of the 
modules; 

when each of the data-sourcing operations has completed, determining whether one of the 
restructuring modules has all of the subframes required for it to perform an operation; 
if so, issuing a control transaction to the one restructuring module; and 
performing an operation in the one restructuring module after receiving a control 
transaction. 

34. (Previously presented) A computer readable medium having computer executable 
instructions for a digital computer to perform steps comprising the method of claim 33. 

35. (Original) The method of claim 33 where the source ones of the modules are those 
receiving data from outside the pipe, 

36. (Original) The method of claim 33 where a plurality of the restructuring modules are 
mixers. 

7 
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37. (Original) The method of claim 36 where a plurality of the mixers are cascaded in the 
pipe. 

38. (Original) The method of claim 33 farther comprising: 

when each of the data-sourcing operations has completed, determining whether others of 
the restructuring modules have all of the subframes required for them to perform operations; 

if so, issuing control transactions to the other restructuring modules; 

performing operations in the other restructuring modules after receiving the control 
transactions, 

39. (Previously presented) The method of claim 33 further comprising: 
storing a separate completion flag for each of the modules in the pipe; and 
setting one of the completion flags when a corresponding one of the modules has 

completed an operation upon a subframe. 

40. (Original) The method of claim 39 where the determining step comprises: 

reading a table listing all of the other modules that source data to the one restructuring 
module; 

determining whether a completion flag for all of the other modules has been set. 

41 . (Previously presented) The method of claim 33, wherein the pipe accommodates 
performance of operations upon a plurality of composite frames concurrently. 

42. (Original) The method of claim 4 1 further comprising constructing a separate frame 
control table for each of the composite frames. 
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43 . (Currently amended) A computer-readable medium having stored thereon a data 
structure for processing streaming data through multiple restructuring processing modules in a 
graph, comprising: 

a s ingle composite frame physically allocated in a memory; aad 

a plurality of virtual subframes allocated within the composite frame for storing the 
streaming data: and 

a nine control table repre senting a structure of a pipe of modules for processing thg 
sfreaming data, wherein the pipe is a connected group of multiple ones of the processing modules in 
the graph, at least one of the modules being a restructuring module. 

whereby the streaming dat a are transported through different ones of the modules in the 
group in different ones of the subf rames and restructured among at least some of the subframes in 
the restructuring module. 

44. (Original) The structure of claim 43 where different ones of the subframes contain 
different types of data. 



45. (Original) The structure of claim 44 where one type of data is video data. 

46. (Original) The structure of claim 44 where another type of data is audio data. 

47. (Original) The structure of claim 43 further comprising an offset table for locating the 
subframes with respect to the composite frame. 

48. (Original) The structure of claim 47 where the offset table includes an entry for each of 
the subframes and a column for specifying the locations of the subframes within the composite 
frame. 
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49. (Canceled) The structure of claim 43 farther comprising a pipe control table representing 
the structure of a pipe of modules for processing streaming data in the data structure. 

50. (Currently amended) The structure of claim 43 4£ where the pipe control table includes 
an entry for each of the modules in the pipe. 

51- (Original) The structure of claim 50 where the pipe control table includes a source 
column for listing other modules that source data to the modules in each of the entries . 

52. (Original) The structure of claim 50 where the pipe control table includes a start section 
listing those modules that source data from outside the pipe. 

53. (Original) The structure of claim 43 further comprising a frame control table for tracking 
the status of the frame with respect to the processing modules. 

54. (Original) The structure of claim 53 where the frame control table includes an entry for 
each of the modules in the pipe. 

55. (Original) The structure of claim 54 where the frame control table includes a column for 
holding flags indicating that each of the modules has completed processing the frame. 

56. (Original) The structure of claim 53 further comprising a separate frame control table for 
each frame circulating in the pipe at a particular time. 

57. (Previously presented) A computer system for processing streaming data, comprising: 
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a plurality of modules for processing the streaming data, at least some of which are 
restructuring; 

a plurality of memory managers for allocating composite frames containing subframes for 
containing streaming data; and 

a flow manager for constructing a graph as a sequence of the modules for accepting and 
processing the streaming data to achieve desired output data, for dividing the graph to define a 
pipe according to performance parameters for each of the modules and the graph as a whole, 
wherein the pipe is a connected group of multiple ones of the modules, including a plurality of 
the restructuring modules, and for assigning one of the memory managers to the pipe. 

58. (Previously presented) The system of claim 57 further comprising a common memory 
area for storing the composite frames. 

59. (Previously presented) The system of claim 58 where the subframes are allocated within 
the composite frames in the common memory area. 

60. (Original) The system of claim 58 further including a processor. 

61. (Original) The system of claim 60 where the processor implements one of more of the 
restructuring modules. 

62. (Original) The system of claim 60 further including an input/output system. 

63. (Original) The system of claim 62 where the input/output system implements one or more 
of the modules. 
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64. (Original) The system of claim 57 further comprising a pipe manager for constructing 
representation of the structures of the composite frames. 

65. (Original) The system of claim 64 where one of the representations specifies location of 
the subframes with respect to the composite frame. 

66. (Original) The system of claim 64 where one of the representations specifies relationships 
of the modules within the pipe. 

67. (Original) The system of claim 57 further including a control manager for transporting the 
streaming data through the modules in various ones of the subframes. 

68. (Previously presented) The system of claim 67 where the control manager issues a control 
transaction to one of the restructuring modules for initiating processing of a subframe therein 
only when all of the subframes processed by that module become available. 

69. (Previously presented) A computer system for processing streaming data, comprising: 
a plurality of modules for processing the streaming data, at least some of the modules 

being restructuring; 

a plurality of memory managers for allocating composite frames containing subframes for 
containing streaming data, different ones of the subframes being associated with different ones of 
the modules; 

a flow manager for constructing a graph as a sequence of the modules for accepting and 
processing the streaming data to achieve desired output data, for dividing the graph to define a 
pipe according to performance parameters for each of the modules and the graph as a whole, 
wherein the pipe is a connected group of multiple ones of the modules, including a plurality of 
the restructuring modules, and for assigning one of the memory managers to the pipe; and 
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a control manager for issuing control transactions for initialing processing operations in 
the modules. 

70. (Original) The system of claim 69 where the control manager issues one of the control 
transactions to a particular module only when certain of the subframes associated with that 
module become available. 

71 . (Original) The system of claim 70 where the certain subframes include all of the 
subframes that source data to the particular module. 

72. (Original) The system of claim 69 where certain of the modules receive data from outside 
the pipe. 

73. (Original) The system of claim 72 where the control manager issues a control transaction 
to the certain modules when one of the composite frames has been allocated. 

74. (Original) The system of claim 69 where at least some of the restructuring modules are 
mixers for combining multiple ones of the subframes. 

75* (Original) The system of claim 74 where a plurality of the mixers are cascaded in the 
pipe. 

76. (Original) The system of claim 75 where the control manager issues one of the control 
transactions to any of the mixers only when all of the subframes combined by that mixer become 
available. 



Received from <> at 9/22/03 2:39:18 PM [Eastern Daylight Time] 



SEP: : 22.2003 1 : 34PM LVM 31 2 61 6 5700 NO. 3225 P. 16 

In re Appln. of Lisitsa et al 
Serial No. 09/310,596 

77. (Previously presented) The system of claim 69 further comprising a common memory 
area for storing the composite frames. 

78. (Previously presented) The system of claim 77 where a processor implements one or 
more of the restructuring modules. 

79. (Original) The system of claim 78 further including an input/output system implementing 
one or more of the modules. 

80. (Previously presented) A computer readable medium bearing instructions and data for 
causing a digital computer to execute a method for processing frames of streaming data through 
modules in a digital computer, the method comprising: 

constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define a pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein the pipe is a connected group of multiple ones of the 
modules, at least one of the modules being restructuring; 

providing a common memory area accessible to the modules within the pipe for storing 
streaming data; 

allocating composite frames in the common memory area, each composite frame having 
predefined subframes; 

transporting the streaming data through different ones of the modules in the group in 
different ones of the subframes; and 

restructuring the data among at least some of the subframes in the restructuring module. 
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81 . (Previously presented) A computer readable medium bearing instructions and data for 
causing a digital computer to execute a method for processing frames of streaming data through 
multiple modules disposed in a pipe in a digital computer, the method comprising: 

constructing a graph as a sequence of the modules for accepting and processing the 
frames of streaming data to achieve desired output data; 

dividing the graph to define the pipe according to performance parameters for each of the 
modules and the graph as a whole, wherein the pipe is a connected group of multiple ones of the 
modules, at least one of the modules being a restructuring module; 

allocating a composite frame having multiple subframes; 

performing operations upon the subframes in any of the modules sourcing data to the 
restructuring module; 

after completion of the operations for all of the subframes sourcing data to the 
restructuring module, issuing a control transaction to the restructuring module; and 

performing operations upon the subframes sourced to the restructuring module in 
response to the control transaction. 

REMARKS 

Claims 1-8 and 10-81 were pending in this application. The Office Action allowed 
claims 1-8, 10-42, and 57-81. The Office Action, however, rejected claims 43-56, which are 
directed to a computer-readable medium having a data structure in accordance with the 
invention, under 35 U.S.C, § 101 for the reason that the claimed invention is inoperative and 
therefore lacks utility. The Action was made final. 

As to the rejection of claims 43-56, applicants have rewritten independent claim 43 to 
address the operativeness aspect, and it is believed that the rewritten claim 43 has overcome the 
Section 101 rejection. Accordingly, this application is now in condition for allowance, and the 
Examiner is respectfully requested to pass this application to issue. If, in the opinion of the 
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